Multi-label classification aims at assigning more than one label to each instance. Many real-world multi-label classification tasks are high dimensional, leading to reduced performance of traditional classifiers. feature selection is a common approach to tackle this issue by choosing prominent features. Multi-label feature selection is an NP-hard approach, and so far, some swarm intelligence-based strategies and have been proposed to find a near optimal solution within a reasonable time. In this paper, a hybrid intelligence algorithm based on the binary algorithm of particle swarm optimization and a novel local search strategy has been proposed to select a set of prominent features. To this aim, features are divided into two categories based on the extension rate and the relationship between the output and the local search strategy to increase the convergence speed. The first group features have more similarity to class and less similarity to other features, and the second is redundant and less relevant features. Accordingly, a local operator is added to the particle swarm optimization algorithm to reduce redundant features and keep relevant ones among each solution. The aim of this operator leads to enhance the convergence speed of the proposed algorithm compared to other algorithms presented in this field. Evaluation of the proposed solution and the proposed statistical test shows that the proposed approach improves different classification criteria of multi-label classification and outperforms other methods in most cases. Also in cases where achieving higher accuracy is more important than time, it is more appropriate to use this method.

feature selection is an important step in data preprocessing, which helps  reducing the dimensionality of data and simplifying the models. This process not only reduces the computational complexity of models, but also improves their accuracy by eliminating irrelevant features and noise. The three most widely used approaches for feature selection are filter, wrapper and embedded methods.  In this paper, first we review some support vector machine based Mixed-Integer Linear Programming (MILP) models and Supervised Infinite feature Selection (Inf-FS$_s$) method.  Then, we propose three hybrid approaches based on them. The first approach involves solving the relaxed linear model of the underlying  MILP model and then solving the MILP model for those features with nonzero weights, namely a smaller MILP. In the second approach, first the Inf-FS$_s$ method is applied to rank the features. Then depending on the features costs, either chooses the top features from the ranked features until budget parameter is reached  or solves a knapsack problem to select cost effective features. The third approach applies the first approach to the top $20\%$ of features ranked by Inf-FS$_s$ method. To evaluate the proposed approaches' performance, experiments are conducted on four high-dimensional benchmark datasets for fixed and random features costs. Results demonstrate that using either of the proposed approaches can significantly reduce running time of MILP models with comparable accuracies with the original MILP models.

Hyperspectral sensors provide a large number of spectral bands. This massive and complex data structure of hyperspectral images presents a challenge to traditional data processing techniques. Therefore, reducing the dimensionality of hyperspectral images without losing important information is a very important issue for the remote sensing community. We propose to use overlap-based feature weighting (OFW) for supervised feature extraction of hyperspectral data. In the OFW method, the feature vector of each pixel of hyperspectral image is divided to some segments. The weighted mean of adjacent spectral bands in each segment is calculated as an extracted feature. The less the overlap between classes is, the more the class discrimination ability will be. Therefore, the inverse of overlap between classes in each band (feature) is considered as a weight for that band. The superiority of OFW, in terms of classification accuracy and computation time, over other supervised feature extraction methods is established on three real hyperspectral images in the small sample size situation.

To find out the level of processing of pre-attentive objects we preferred to use cues, i.e., a transient visual stimuli that may attract attention automatically or voluntarily (peripherally or centrally presented cues). In one of our recent experiments (Authors, Unpublished experiment), we observed that color similarity of cue and target does not improve subject's performance in a peripherally cued detection task. In this paper we describe another experiment which had two kinds of symbolic cues presented in the fixation point (at the center) and showed the subjects where to deploy their attention (right or left) according to their shapes. Subjects were asked to detect the target (i.e. a simple detection task) or to discriminate between two alternate targets, different in some features except color (i.e. a common discrimination task). We compared the reaction time (RT) in both types in same feature condition (target's color. was similar to cue's) and different feature condition(target's color was different from cue's). Results showed significant difference between them. So we concluded that with increased exposure, color -as an unattended feature of the central cue- can also get processed and improve subjects performance.